Write Kafka Topic
(Kafka Connector)
Synopsis
This operator sends all examples of an ExampleSet as messages to a Kafka topic.Description
It can either send all examples directly after each other, or can wait a specified amount of time between each message. The examples can be either written as a plain string or as a JSON formatted message.
Input
connection (Connection)The connection to the Kafka server, to where the messages are send.
example set (Data Table)The input ExampleSet which should be pushed to the Kafka topic
Output
- out (Data Table)
The unchanged ExampleSet is passed through.
Parameters
- kafka_topic
The name of the Kafka topic to which should be send.
Range: - update_topics
Try to retrieve a list of available topics from server.
Range: - bulk_sending
Should all messages be send directly? If true, each example will still be send as an individual message, but directly after each other. If false there will be a delay specified by the message interval parameter.
Range: - message_interval
Delay between the sending of each example in milliseconds.
Range: - message_format
The format of the message send. It will be either a JSON format string with the attribute names and values or a simple string that only contains the attribute values.
Range: - attribute_separator
If the message format is a single string, this is the separator between the attributes.
Range:
Tutorial Processes
Simple Write Kafka Topic
In this tutorial process the usage of the Write Kafka Topic operator is demonstrated.
